Interactive computer program with virtualized participant

ABSTRACT

An infrastructure for an interactive computer program comprising a computer generated environment. The infrastructure comprises an instrument module, a first display and a second display. At least one tangible instrument allows the user to interact within the computer generated environment, at least one virtualized instrument is not accessible to the user. The first display displays images from the computer generated environment. The second display is positioned on one side of the instrument module for displaying at least images of the virtualized instrument(s) and of a virtualized participant that has access to the virtualized participant of the interactive computer program. A method comprising providing the tangible instrument and the first display screen The method also comprises displaying images of the virtualized instrument and the virtualized participant on the second display screen.

PRIORITY STATEMENT

This non-provisional patent application claims priority based upon thePCT patent applications entitled “INTERACTIVE COMPUTER PROGRAM WITHVIRTUALIZED PARTICIPANT”, filed on even date herewith, in the name ofCAE Inc., the PCT application entitled “NIGHT VISION DETECTIONENHANCEMENTS IN A DISPLAY SYSTEM”, filed on even date herewith, in thename of CAE Inc. and the PCT application entitled “MULTIFACTOR EYEPOSITION IDENTIFICATION IN A DISPLAY SYSTEM”, filed on even dateherewith, in the name of CAE Inc., all of which being incorporated byreference in their entirety.

TECHNICAL FIELD

The resent invention relates to an interactive computer program and,more particularly, to a multi-party interactive computer program.

BACKGROUND

Interactive computer programs, such as simulators or, more particularly,flight simulators, typically involve complex display systems meant toemulate a real environment. For the same purpose, an infrastructure thatcomprises instruments from the real environment or instruments emulatinginstruments from the real environment is also typically provided.Reference is now made to the drawings in which FIG. 1 shows an exampleof such an infrastructure in accordance with the prior art. A flightsimulator 1000 is depicted that comprises a cockpit 1100 equipped withseats 1110, an instrument module 1120 and window openings 1130 identicalto seats, instruments and window openings found in a real plane. In oneconfiguration, a display system is provided at least three feet (90centimeters) outside of the cockpit 1100 and is visible for the seatedusers through the windows openings 1130.

To maintain the required level of realism, the number of users of theflight simulator 1000 in normal operation is limited to its number ofseats. The present invention provides a solution that alleviates thislimitation.

SUMMARY

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

A first aspect of a first set of embodiments of the present invention isdirected to an infrastructure for an interactive computer programcomprising a computer generated environment. The infrastructurecomprises an instrument module, a first display and a second display.The instrument module comprises at least one tangible instrument for theuser to interact within the computer generated environment, the tangibleinstrument(s) being accessible to a user of the interactive computerprogram and at least one virtualized instrument not accessible to theuser of the interactive computer program. The first display ispositioned in front of the user for displaying images from the computergenerated environment interactive computer program. The second displayis positioned on one side of the instrument module for displaying atleast images of the virtualized instrument(s) and of a virtualizedparticipant of the interactive computer program. The tangible instrumentis not accessible to the virtualized participant of the interactivecomputer program and the virtualized instrument(s) is accessible to thevirtualized participant of the interactive computer program.

The infrastructure may comprise a seat for the user and the tangibleinstrument(s) may be accessible while the user is seated.

The virtualized participant may be controlled by artificial intelligenceto mimic reactions of a co-user of the interactive computer program.

The infrastructure may further comprise an instructor station forallowing an instructor to participate to the interactive computerprogram. The instructor station may allow the instructor to participateto the interactive computer program and to participate in additionalcorresponding interactive computer programs.

The virtualized participant may represent a co-user of the interactivecomputer program in a second infrastructure. The instrument module mayfurther comprise at least one shared tangible instrument concurrentlyaccessible to the user from the infrastructure, a corresponding sharedtangible instrument being concurrently accessible the co-user in thesecond infrastructure. The instrument module may further comprise aninstrument driver for moving the shared tangible instrument(s) based onmovements of the corresponding shared tangible instrument from theco-user in the second infrastructure. An instructor station may also beprovided for allowing an instructor to participate to the interactivecomputer program. The instructor station may allow the instructor toparticipate to the interactive computer program and to participate inadditional corresponding interactive computer programs.

The second display may provide a virtual instructor station for managingsettings of the interactive computer program.

The infrastructure may further comprise a sightline tracking module fortracking at least one factor of the user's sightline for parallaxgeometry correction of the images displayed on at least one of the firstdisplay and the second display.

A second aspect of the first set of embodiments of the present inventionis directed to a method for providing an interactive computer program inan infrastructure. The method comprises providing a tangible instrumentfor a user to interact with the interactive computer program, a firstdisplay screen displaying a computer generated environment of theinteractive computer program. The method also comprises displayingimages of a virtualized instrument of the interactive computer programon a second display screen and displaying images of a virtualizedparticipant of the interactive computer program on the second displayscreen. The tangible instrument is not accessible to the virtualizedparticipant and the virtualized instrument is accessible to thevirtualized participant.

The method may further comprise controlling the virtualized participantby artificial intelligence to mimic reactions of a co-user of theinteractive computer program.

The method may further also comprise allowing an instructor toparticipate to the interactive computer program from an instructorstation. Allowing the instructor to participate to the interactivecomputer program may further comprise allowing the instructor toparticipate to the interactive computer program and to participate inadditional corresponding interactive computer programs.

The virtualized participant may also represent a co-user of theinteractive computer program in a second infrastructure. The method maythen comprise providing a second tangible instrument for the co-user tointeract with the interactive computer program from the secondinfrastructure, the second tangible instrument corresponding to thevirtualized instrument and the second infrastructure displaying thecomputer generated environment of the interactive computer program tothe co-user. The method may then also comprise displaying images of thetangible instrument as a second virtualized instrument of theinteractive computer program to the co-user. The tangible instrument isnot accessible to the virtualized participant and the virtualizedinstrument is accessible to the virtualized participant. In thisexample, the method may yet further comprise providing at least oneshared tangible instrument concurrently accessible to the user from theinfrastructure, a corresponding shared tangible instrument beingconcurrently accessible the co-user in the second infrastructure andmoving the shared tangible instrument(s) based on movements of thecorresponding shared tangible instrument from the co-user in the secondinfrastructure. The method may also comprise allowing an instructor toparticipate to the interactive computer program from an instructorstation.

The method may further comprise providing an interactive computerprogram engine for managing settings of the interactive computer programand/or for managing settings of the infrastructure.

A first aspect of a second set of embodiments of the present inventionis directed to a modular infrastructure for an interactive computerprogram comprising a computer generated environment. The modularinfrastructure comprises an instrument module, a first display and asecond display. The instrument module comprises at least one tangibleinstrument for the user to interact within the computer generatedenvironment, the tangible instrument(s) being accessible to a user ofthe interactive computer program and at least one virtualized instrumentnot accessible to the user of the interactive computer program. Thefirst display is positioned in front of the user for displaying imagesfrom the computer generated environment interactive computer program.The second display is for displaying at least images of the virtualizedinstrument(s). An instrument position of the instrument module relativeto a display position of the second display is customizable in themodular infrastructure to support different configurations of theinteractive computer program.

The modular infrastructure may comprise a seat for the user and the atleast one tangible instrument may thus be accessible while the user isseated. The second display may be positioned beside the user whileseated and may further display images of a virtualized participant ofthe interactive computer program having access to the virtualizedinstrument(s).

When the modular infrastructure comprises a seat, a first tangibleinstrument of the tangible instrument(s) may be positioned between theseat and the first screen and a second tangible instrument of thetangible instrument(s) may be positioned between the seat and the seconddisplay. The second tangible instrument may be configurable to beprovided on the left of the seat in a first of the differentconfigurations and on the right of the seat in a second of the differentconfigurations.

The second display may be configurable to be provided beside the user inone of the different configurations and in the back of the user inanother of the different configurations.

The modular infrastructure may comprise a seat for the user and a secondseat for a second user of the modular infrastructure, a first of thetangible instrument(s) being accessible to the user while seated and asecond of the tangible instrument(s) being accessible to the second userwhile seated. The second display may be configurable to be providedwhile the user and the second are side-by-side in one of the differentconfigurations and in the back of the user and the second user inanother of the different configurations. The second display, in one ofthe different configurations, may also be configurable to be providedfacing the user between the user and the second user, wherein the secondof the at least one tangible instrument corresponds to the virtualizedinstrument, the modular infrastructure further comprising a thirdscreen, facing the second user provided between the user and the seconduser, for displaying at least images of a second virtualized instrumentcorresponding to the at least one tangible instrument.

The modular infrastructure may further comprise an instructor stationfor allowing an instructor to participate to the interactive computerprogram.

The second display may provide a virtual instructor station for managingsettings of the interactive computer program.

The modular infrastructure may further comprise a sightline trackingmodule for tracking at least factor of the user's sightline for geometrycorrection of the images displayed on at least one of the first displayand the second display.

The modular infrastructure may further comprise equipment from aconventional infrastructure. A first configuration of the differentconfigurations may be a two-user configuration and a second of thedifferent configurations may provide a one-user configuration in whichonly one user position is maintained, the first configuration settingthe instrument position for allowing the instrument module to beaccessible from the one user position, the display position being setsuch that the second display fits within the other user position.

A second aspect of the second set of embodiments of the presentinvention is directed to a method for modifying a modularinfrastructure, configured for an interactive computer program in afirst configuration. The method comprises repositioning at least onetangible instrument in the modular infrastructure for a secondconfiguration of the interactive computer program. The tangibleinstrument(s) is adapted for allowing a user, having a first roleprogram in the first configuration, to interact in the interactivecomputer program under a second role in the second configuration. Themethod also comprises configuring a position for a virtualizedinstrument in the second configuration of the interactive computerprogram and repositioning a display in view of the tangibleinstrument(s) repositioned in the second configuration and the positionof the virtualized instrument in the second configuration of theinteractive computer program. The method then comprises displaying atleast images of the virtualized instrument at the position in the secondconfiguration on the second display.

The modular infrastructure may be a modifiable conventionalinfrastructure.

Configuring the position for the virtualized instrument in the secondconfiguration may be performed from a management interface of an engineof the interactive computer program. The method may further comprisemanaging settings of the interactive computer program and/or settings ofthe modular infrastructure from the management interface. The settingsmay comprise simulation parameters, at least one general lightingparameter and/or at least one ambient temperature parameter.

BRIEF DESCRIPTION OF THE DRAWINGS

Further features and exemplary advantages of the present invention willbecome apparent from the following detailed description, taken inconjunction with the appended drawings, in which:

FIG. 1 is a perspective view of an infrastructure in accordance with theprior art;

FIG. 2 is a modular representation of an exemplary infrastructure inaccordance with the teachings related to at least a first aspect of thepresent invention;

FIG. 3 is a perspective view of an exemplary infrastructure inaccordance with the teachings related to at least a first aspect of thepresent invention;

FIG. 4 is a front view of an exemplary secondary display in accordancewith the teachings related to at least a first aspect of the presentinvention;

FIG. 5 is a modified perspective view of exemplary infrastructures inaccordance with the teachings related to at least a first aspect of thepresent invention;

FIG. 6 is a modular and functional representation of an exemplary systemin accordance with the teachings related to at least a first aspect ofthe present invention;

FIG. 7 is an exploded view of different components compatible with amodular infrastructure in accordance with the teachings related to atleast a second aspect of the present invention;

FIG. 8 is a flow chart of an exemplary method in accordance with theteachings related to at least a first aspect of the present invention;and

FIG. 9 is a flow chart of an exemplary method in accordance with theteachings related to at least a second aspect of the present invention.

DETAILED DESCRIPTION

In accordance with a first set of embodiments of the present invention,an infrastructure is provided for an interactive computer programcomprising a computer generated environment. The infrastructurecomprises an instrument module, a first display and a second display.The instrument module comprises at least one tangible instrument for theuser to interact within the computer generated environment and at leastone virtualized instrument not accessible to the user of the interactivecomputer program. The tangible instrument(s) is accessible to a user ofthe interactive computer program. The first display is positioned infront of the user and displays images from the computer generatedenvironment interactive computer program. The second display ispositioned on one side of the instrument module and (at least) displaysimages of the virtualized instrument and of a virtualized participant ofthe interactive computer program. The tangible instrument(s) is notaccessible to the virtualized participant of the interactive computerprogram and the virtualized instrument(s) is accessible to thevirtualized participant of the interactive computer program. Forinstance, the virtualized participant may be a second user in a secondinfrastructure sharing the same computer generated environment or couldbe an artificially-generated participant of the interactive computerprogram.

In accordance with a second set of embodiments of the present invention,a modular infrastructure is provided for an interactive computer programcomprising a computer generated environment. The modular infrastructurecomprises an instrument module, a first display and a second display.The instrument module comprises at least one tangible instrument for atleast one user to interact within the computer generated environment andat least one virtualized instrument not accessible to the user of theinteractive computer program. The tangible instrument(s) is accessibleto the user(s) of the interactive computer program. The first display ispositioned in front of the user(s) and displays images from the computergenerated environment interactive computer program. The second displaydisplays at least images of the at least one virtualized instrument,wherein an instrument position of the instrument module relative to adisplay position of the second display is customizable in the modularinfrastructure to support different configurations of the interactivecomputer program. For instance, a first configuration may require thesecond display to be one on a right side of a user and a secondconfiguration may require the second display to be behind the user, onthe left side of a user or distributed between different locationsaround the user.

Reference is now made concurrently to FIG. 2, which shows a logicalmodular representation of an exemplary infrastructure 2000, FIG. 3,which shows an exemplary modular representation of the exemplaryinfrastructure 2000, and FIG. 4, which shows a non-perspective view ofan exemplary secondary screen 2300 of the exemplary infrastructure 2000,in accordance with the first set of embodiments of the presentinvention. The infrastructure 2000 is used in the context of aninteractive computer program comprising a computer generatedenvironment. The interactive computer program may be a trainingsimulation program such as a flight simulation software, as exemplarilydepicted on FIG. 3. The computer generated environment is related to theinteractive computer program and may for instance be a virtualrepresentation of a real region of the world or a fictional world wherethe interactive computer program (e.g., the simulation) can take place(e.g., the Greater Montreal area with a detailed representation of atleast some of its airports). The interactive computer program may alsobe related to a simulation involving a simulated vehicle, which may beterrestrial (car, tank, etc.), underground, airborne (e.g., an aircraft(as exemplarily depicted on FIG. 3), a space shuttle, etc.), floating(e.g., a boat), etc. The interactive computer program may also berelated to a game, which could differ from the simulation because of thedifferent rules that apply in the computer generated environment (e.g.,varying gravity force, presence of unrealistic elements (force fields),varying response to damages, varied capacity to undo or affect pastactions, success measured on different results, etc.).

The infrastructure 2000 comprises an instrument module 2100, a first ormain display 2200 and the second or secondary display 2300. The maindisplay 2200 could be split into one or more flat panels fitting one ormore openings, as depicted in FIG. 3, but could also be a single flat orcurved screen visible though one or more openings. For instance, themain display 2200 may comprise one or more projectors mounted projectingimages on a curved refracting screen. The curved refracting screen maybe located far enough from the user of the interactive computer programto provide a collimated display. Alternatively, the curved refractingscreen may provide a non-collimated display. If and when informationabout the user's eye position is determined to be required to maintainthe expected level of realism, such information about the user's eyeposition may be obtained using multiple factors, as exemplified inpreviously identified co-pending applications. The first display 2200 ispositioned in front of the user and displays images from the computergenerated environment of the interactive computer program.

The instrument module 2100 comprises at least one tangible instrument2120 for the user to interact within the computer generated environmentand at least one virtualized instrument 2130 not accessible to the userof the interactive computer program (i.e., the virtualized instrument2130 depicted on the secondary display 2300 cannot be manipulateddirectly by the user). The instrument module 2100 may comprise more thanone physical module that may further be interconnected to provide agiven configuration of the interactive computer program. Skilled personswill readily acknowledge that the position of the user in relation tothe instrument module 2100 and the secondary display 2300 may be changedwithout affecting the teachings of invention. More specifically, thesecondary screen 2300 could be on the left, the right or in the rear ofthe user of the interactive computer program.

For instance, in relation to an exemplary flight simulator, the tangibleinstruments 2120 may comprise a control yoke and/or side stick (asexemplarily identified as 2120 on FIG. 3), rudder pedals, a throttle, aflap switch, a transponder, a landing gear lever, a parking breakswitch, etc. Examples of the at least one virtualized instrument 2130not accessible to the user may comprise an image of a control yokeand/or side stick (as exemplarily identified as 2130 on FIG. 4), animage of a rudder pedals, an image of a throttle, an image of a flapswitch, an image of a transponder, an image of a landing gear lever, animage of a parking break switch, etc.

The tangible instrument(s) 2120 is accessible to a user of theinteractive computer program. The second display 2300 is positioned onone side of the instrument module 2100 and (at least) displays images ofthe virtualized instrument 2130 and of a virtualized participant 2600 ofthe interactive computer program. The tangible instrument(s) 2120 is notaccessible to the virtualized participant 2600 of the interactivecomputer program and the virtualized instrument(s) 2130 is accessible tothe virtualized participant 2600 of the interactive computer program.For instance, the virtualized participant 2600 may be a second user in asecond infrastructure (not shown on FIG. 2) sharing the same computergenerated environment or could be an artificially-generated participantof the computer program.

The secondary display 2300 may be a single custom-shaped flat screen,but could also be a single regular-shaped flat screen, an array ofsmaller screens or any other type of display that allows for arepresentation of the virtualized participant 2600 and the virtualizedinstrument(s) 2130. It is also expected that the secondary display 2300could be a curved and/or foldable screen that may be tailored to aspecific configuration of the physical space that the secondary display2300 can occupy. The secondary display 2300 may also be formed by one ormore projectors and one or more screens. Many projectors may projectimages on a single screen or on multiple screens. Likewise, a singleprojector may project images on multiple screens. The projector(s) maybe located within the infrastructure 2000 or outside the infrastructure2000, projecting images on the secondary display 2300 within theinfrastructure 2000. The representation of the virtualized participant2600 and the virtualized instrument(s) 2130 may cover the whole visiblefield from the perspective of the user (as exemplified by the full scalesingle custom-shaped flat screen as depicted in FIG. 3 and FIG. 4 or asa foldable/curved screen may be able to provide) but could also belimited in size and provide a limited visible field of view for the user(e.g., using single regular-shaped flat screen). The secondary display2300 may also provide images from selected portions of the whole visiblefield from the perspective of the user, e.g., using the array of smallerscreens. The secondary display 2300 could be symmetrical along thevertical axis (e.g., so that it can be flipped horizontally to be usedon different sides of the instrument module 2100).

The images displayed on the secondary display 2300 may also provideimages of the computer generated environment of the interactive computerprogram, e.g., through displayed virtual openings 2130′ as depicted onFIG. 4.

Skilled persons will recognize that the images displayed on thesecondary display 2300 may advantageously take into account an expectedposition of the user's eye and/or the user's sightline to displaysufficiently realistic virtual participant 2600 and virtualizedinstrument(s) 2130 (i.e., with at least a basic geometry correction,e.g., to simulate perspective and parallax effect). The expectedposition of the eyes or sightline of the user may be a static valueentered for any users, a static value determined for each user (e.g.,based on biometric values) or may be dynamically computed. The eyeposition or sightline may comprise only a basic position of the user'sbody or user's body part or may further comprise the user's eye-levelheight and horizontal rotational attitude at the eye-level, which is ofparticular relevance when 3D images are displayed on the main display2200 and/or secondary display 2300. For instance, in one embodiment ofthe first set of embodiments, the infrastructure 2000 may furthercomprise a sightline tracking module 2500 for tracking, at runtime(i.e., during execution of the interactive computer program), at leastone factor of the user's sightline for geometry correction of the imagesdisplayed on at least one of the first display 2200 and the seconddisplay 2300. Because of the proximity of the secondary display 2300,the sightline tracking module 2500 when applied to the secondary display2300, while it is an optional feature, is expected to significantlyimprove realism of the interactive computer program as perceived by theuser. Of course, depending on the technology used for the main display2200, the sightline tracking module 2500 may also be significant, whileit is an optional feature, to improve realism of the interactivecomputer program as perceived by the user.

The user, in the infrastructure, may be standing or in motion. Theinfrastructure 2000 may also comprise a seat 2700 for the user. In thisexample, the tangible instrument(s) 2120 is accessible while the user isseated, standing or in motion.

The virtualized participant 2600 may be controlled by artificialintelligence to mimic actions and reactions of a co-user generated bythe interactive computer program.

The infrastructure 2000 may further comprise an interactive computerprogram engine 2400 (e.g., simulation engine) for managing settings ofthe interactive computer program (e.g., simulation parameters) and/or ofthe infrastructure 2000 (e.g., general lighting, ambient temperature).The interactive computer program engine 2400 may for instance manage thecomputer generated environment loaded from an environment database 2410and may also influence the interactive computer program behavior (e.g.,by implementing certain interactive sessions or simulation scenarios,etc.). The interactive computer program engine 2400, when present, maycomprise a network interface module (not shown) and/or dedicated wire orwireless interfaces (not shown) to interact with other modules of theinfrastructure 2000 or with other external network modules (e.g., one ormore additional infrastructures and/or a shared or dedicated instructormodule), for instance, via a network 2900.

The infrastructure 2000 may also comprise dedicated image generators(not shown) for the main display 2200 and/or the secondary display 2300.The interactive computer program engine 2400 may further comprise or mayfurther interact with the dedicated image generators.

The infrastructure 2000 may further comprise a computer programmanagement interface 2310, which may be displayed on the secondarydisplay 2300 or may also be provided on at least one extra device (notshown) such as a wired touch-sensitive display, a tablet computer, aportable computer or a smart phone. The extra device could be located inclose proximity with the user and the infrastructure 2000, but may alsobe provided outside of the infrastructure 2000, in communicationtherewith. When multiple extra devices are used, they present differentviews of the computer program management interface 2310 (e.g., to managedifferent aspects therewith) or may they may all present the same viewthereof. The computer program management interface 2310 may also bepermanently shown (e.g., on the secondary display 2300), may betriggered by a touch gesture when the secondary screen is touchsensitive and/or may be triggered by an event in the interactivecomputer program (e.g., milestone reached, unexpected action from theuser, or action outside of expected parameters, success or failure of acertain mission, etc.). The computer program management interface 2310may provide a virtual instructor station that allows the user tointeract with the interactive computer program engine 2400 for at leastmanaging settings of the interactive computer program and/or of theinfrastructure 2000. Someone else present with the user (e.g., aninstructor) may also be in control of the computer program managementinterface 2310 (e.g., on a portion of the secondary display 2300 noteasily accessible to the user or on the extra device).

The instrument module 2100 may further comprise a dedicated input/output(I/O) module 2110. Likewise, the sightline tracking module 2500 may alsocomprise an I/O module 2510. An interface 2114/2514 of the I/O module2110/2510 may be used to interact with the secondary display 2300 toprovide and/or affect the images. The interactions between instrumentmodule 2100, the sightline tracking module 2500 and/or the secondarydisplay 2300 may be direct interactions (e.g., via the I/O interface2114) of via other modules (e.g., interactive computer program engine2400), which may be dedicated to the image generation (not shown). TheI/O module 2110/2510 may also comprise a network interface 2112/2512 forcommunicating with other modules of the infrastructure 2000 or withother external network modules (e.g., one or more additionalinfrastructures and/or a shared or dedicated instructor module), forinstance, via the network 2900.

The secondary display 2300, in addition to the virtual participant 2600,may also provide images of additional virtual participant(s) perceivedby the user(s) as being positioned beside the virtual participant 2600.In the depicted example of FIG. 3 and FIG. 4, a single secondary display2300 is provided. Skilled persons will recognize that the user could bepositioned between the secondary display 2300 and an additional display(not shown). The user would then perceive as being positioned between oramong two or more virtual participants. Similarly, the additionaldisplay could be provided (in addition or alternatively) behind theuser, e.g., to display passengers and/or additional virtual participantsof the interactive computer program (e.g., gunner(s) in a militaryhelicopter). The user(s) could be seated and/or standing and/or inmotion in the infrastructure 2000. Likewise, the virtual participant(s)may be depicted as being seated and/or standing and/or in motion.

FIG. 5 shows an exemplary dual configuration in accordance with oneaspect of the first set of embodiments of the present invention. Theinfrastructure 2000 is depicted on the left (the secondary display 2300being omitted for increased clarity). A second complementaryinfrastructure 3000 is depicted on the right. The virtualizedparticipant 2600 represents a real co-user of the interactive computerprogram in the second infrastructure 3000. Likewise, a second virtualparticipant (not shown) is displayed in the second infrastructure 3000to represent the user of the interactive computer program in theinfrastructure 2000.

The infrastructures 2000 and 3000 may be equipped with one or multiplecameras (not shown) to mimic movements of the virtual participant(s).Alternatively or complementarily, the virtual participants may move inaccordance with the virtualized instrument(s) being manipulated in thecorresponding infrastructure. As depicted in the example of FIG. 3, theinstrument module 2100 may further comprise at least one shared tangibleinstrument 2800 concurrently accessible to the user from theinfrastructure 2000, a corresponding shared tangible instrument 2800being concurrently accessible the real co-user in the secondinfrastructure 3000. An instrument actuator may further be provided formoving the shared tangible instrument(s) 2800 based on movements of thecorresponding shared tangible instrument 2800 from the real co-user inthe second infrastructure 3000.

The virtualized instrument 2130 may also be made accessible to the useras an additional shared instrument by configuring the computer programmanagement interface 2310. For instance, by using the computer programmanagement interface 2310, the user may be able to configure virtualswitches displayed at an inaccessible location on the secondary display2300 to be actionable using an additional display of the virtualswitches on a specific touch sensitive portion of the secondary display2300 or on an extra device (tablet, portable computer, smartphone,etc.).

FIG. 6 shows an exemplary system view of a plurality of cooperatinginfrastructures 2000 . . . 5000 in accordance with one aspect of thefirst set of embodiments of the present invention. In this example, oneor more instructor stations 5100, 5200 are provided for allowing one ormore instructors to participate to one or more interactive computerprograms. In the depicted example of FIG. 6, the infrastructures 2000and 3000 are sharing the interactive computer program, as exemplifiedwith particular reference to FIG. 5 and the interactive computer programengine 2400 is present and depicted as a server in communication withthe infrastructures 2000 and 3000. Skilled persons will readilyrecognize that the interactive computer program engine 2400 is anoptional feature of the present invention and that it may be integratedwithin one or more of the infrastructures 2000 and 3000 and/ordistributed over other engines (2440, 2480) and/or over a cloudprocessing engine (not shown). In the example of FIG. 6, theinfrastructure 4000 is managed by the engine 2440, which also generatesan artificial intelligent co-user therefor (which may be referred to asan AI infrastructure). The infrastructure 5000 is depicted as aconventional two-seat infrastructure managed by the engine 2480. Theinfrastructure 5000 may be used in standalone mode (or conventionalmode), but may also be configured such that a single user of theinfrastructure 5000 may interact with a remote infrastructure (notshown) and/or an AI infrastructure. The infrastructure 5000 may also beconfigured such that the two users thereof interact with the remote orAI infrastructure (e.g., in a multi-user, multi-site configuration). Oneor more additional infrastructures (not shown) may be provided with thevirtual participant being in collocated infrastructure(s), remoteinfrastructure(s) and/or controlled by artificial intelligence (asstandalone stations or within a network of infrastructures as depictedon FIG. 6). In addition, as skilled person will readily recognize, whilea role could be permanently assigned thereto, any of the infrastructures2000 . . . 5000 is expected to be configurable for being usable as acollocated cooperating infrastructure and a remotely cooperatinginfrastructure.

FIG. 9 shows a flow chart of an exemplary method 9000 for providing theinteractive computer program in the infrastructure 2000 in accordancewith one aspect of the first set of embodiments, as described withreference to FIG. 2. The method 9000 comprises providing 9010 a tangibleinstrument for a user to interact with the interactive computer program,a first display screen displaying a computer generated environment ofthe interactive computer program. The method also comprises displaying9020 images of a virtualized instrument of the interactive computerprogram on a second display screen and displaying 9030 images of avirtualized participant of the interactive computer program on thesecond display screen. The tangible instrument is not accessible to thevirtualized participant and the virtualized instrument is accessible tothe virtualized participant.

The method 9000 may further comprise controlling the virtualizedparticipant by artificial intelligence to mimic reactions of a co-userof the interactive computer program. The method 9000 may also compriseallowing an instructor to participate to the interactive computerprogram from an instructor station. The instructor may participate tothe interactive computer program and to additional correspondinginteractive computer programs.

The virtualized participant may also represent a co-user of theinteractive computer program in a second infrastructure; the method 9000may then comprise providing a second tangible instrument for the co-userto interact with the interactive computer program from the secondinfrastructure. The second tangible instrument corresponds to thevirtualized instrument and the second infrastructure displays thecomputer generated environment of the interactive computer program tothe co-user. The method 9000 may then further comprise displaying imagesof the tangible instrument as a second virtualized instrument of theinteractive computer program to the co-user. The tangible instrument isnot accessible to the virtualized participant and the virtualizedinstrument is accessible to the virtualized participant. The method 9000may then further comprise providing at least one shared tangibleinstrument concurrently accessible to the user from the infrastructure,a corresponding shared tangible instrument being concurrently accessiblethe co-user in the second infrastructure and moving the at least oneshared tangible instrument based on movements of the correspondingshared tangible instrument from the co-user in the secondinfrastructure. The method 9000 may yet further comprise allowing aninstructor to participate to the interactive computer program from aninstructor station.

The method 9000 may also further comprise providing an interactivecomputer program engine for managing settings of the interactivecomputer program and/or for managing settings of the infrastructure.

In accordance with the second set of embodiments of the presentinvention, a modular infrastructure is provided. FIG. 7 shows differentcomponents that may be fitted into a modular infrastructure 7000 for aninteractive computer program comprising a computer generatedenvironment. The modular infrastructure 7000 comprises an instrumentmodule 7100, a first display 7200 and a second display 7300. Theinstrument module 7100 comprises at least one tangible instrument 7120for the user to interact within the computer generated environment andat least one virtualized instrument (not shown) not accessible to theuser of the interactive computer program. The at least one tangibleinstrument is accessible to the user of the interactive computerprogram.

In a first configuration of the modular infrastructure 7000, the firstdisplay 7200 is positioned in front of the user for displaying imagesfrom the computer generated environment interactive computer program.The second display is for displaying at least images of the at least onevirtualized instrument. An instrument position of the instrument module7100 relative to a display position of the second display 7300 iscustomizable in the modular infrastructure 7000 to support at least oneadditional configuration of the interactive computer program differentfrom the first configuration.

The second display 7300 may be a single custom-shaped flat screen, butcould also be a single regular-shaped flat screen, an array of smallerscreens or any other type of display. It is also expected that thesecond display 7300 could be a curved and/or foldable screen that may betailored to a specific configuration of the physical space that thesecond display 7300 can occupy, which differs between configurations.The second display 7300 could be symmetrical along the vertical axis(e.g., so that it can be flipped horizontally to be used on differentsides of the instrument module 7100). The second display 7300 could bedouble sided where both sides are active at once or where one side at atime is active. The second display 7300 may also be formed by one ormore projectors and one or more screens. Many projectors may projectimages on a single screen or on multiple screens. Likewise, a singleprojector may project images on multiple screens. The projector(s) maybe located within the modular infrastructure 7000 or outside the modularinfrastructure 7000, projecting images on the second display 7300 withinthe modular infrastructure 7000.

The modular infrastructure 7000 may further comprise a seat 7700 for theuser, the at least one tangible instrument being accessible while theuser is seated. The second display 7300 may be positioned beside theuser while seated and may also be for further displaying images of avirtualized participant of the interactive computer program havingaccess to the at least one virtualized instrument.

A first tangible instrument 7124 of the at least one tangible instrumentmay be positioned between the seat 7700 and the first screen 7200 and asecond tangible instrument 7122 of the at least one tangible instrumentis positioned between the seat 7700 and the second display 7300. Thesecond tangible instrument 7122 may further be configurable to beprovided on the left of the seat 7700 in the first of the differentconfigurations and on the right of the seat in a second of the differentconfigurations. The second display 7300 may also be configurable to beprovided beside the user in one of the different configurations and inthe back of the user in another of the different configurations. Thesecond display 7300 may also be formed by a single or a plurality ofdifferent screens in one location around the user (e.g., behind theuser) or in multiple locations around the user (e.g., behind and on theright of the user).

A second seat 7710 for a second user may be provided in someconfigurations of the modular infrastructure 7700. A first of the atleast one tangible instrument 7124 may be accessible to the user whileseated and a second of the at least one tangible instrument 7120 may beaccessible to the second user while seated. The second display 7300 maybe configurable to be provided while the user and the second areside-by-side in one of the different configurations, thereby allowingthe two users to be distant in the interactive computer program (e.g.,having virtualized participant(s) between them). The second display 7300may be configurable to be provided in the back of the user and thesecond user in another of the different configurations (e.g., allowingthe two users to be in a vehicle that looks much larger or that involveadditional virtual participant(s)).

The second display 7300, in one of the different configurations, isconfigurable to be provided facing the user between the user and thesecond user wherein the second of the at least one tangible instrument7120 corresponds to the virtualized instrument, the modularinfrastructure 7000 further comprising a third screen (not shown),facing the second user provided between the user and the second user,for displaying at least images of a second virtualized instrumentcorresponding to the at least one tangible instrument 7124.

An instructor station (not shown) may also be provided for allowing aninstructor to participate to the interactive computer program. Thesecond display 7300 may also, additionally or alternatively, provide avirtual instructor station for managing settings of the interactivecomputer program.

The modular infrastructure 7000 may further comprise a sightlinetracking module for tracking at least factor of the user's sightline forgeometry correction of the images displayed on at least one of the firstdisplay 7200 and the second display 7300.

A conventional multi-user infrastructure (e.g., as the one depicted inFIG. 1 or as the infrastructure 5000) may also be modified in accordancewith the teachings of the present invention to accommodate the secondarydisplay 7300 while the number of users of the infrastructure remains thesame, thereby allowing a higher number of participants (real co-users orAI users) as additional virtual participants to be depicted therein.Alternatively, the secondary display 7300 may replace one of theposition or be adapted to fit within the position of an expected user inthe conventional infrastructure (e.g., the left or right seat in FIG. 1is equipped or replaced with the secondary display 7300). Theconventional infrastructure may thus be permanently modified into themodified infrastructure or may also be temporarily modifiable into themodified infrastructure, based on different needs. The modifiedinfrastructure may then be used for one user (or at least a lower numberof users) compared to the conventional infrastructure. This may allowmaximizing use time of the modifiable/modified infrastructure as it maybe easier to fully book the schedule, e.g., when users from differentinfrastructures (or even different locations, e.g., distributed intraining locations around the world) may enter the same interactivecomputer program or when one or more users is missing and still be ableto enter the interactive computer program with one or more AIparticipants.

FIG. 8 shows a flow chart of an exemplary method 8000 in accordance withthe second set of embodiments of the present invention. The method 8000is for modifying a modular infrastructure 7000 initially configured foran interactive computer program in a first configuration. The method8000 comprises repositioning 8010 at least one tangible instrument inthe modular infrastructure for a second configuration of the interactivecomputer program. The at least one tangible instrument is adapted forallowing a user, having a first role in the interactive computer programin the first configuration, to interact in the interactive computerprogram under a second role in the second configuration. The method alsocomprises configuring 8020 a position for a virtualized instrument inthe second configuration of the interactive computer program andrepositioning 8030 a display in view of the at least one tangibleinstrument repositioned in the second configuration and the position ofthe virtualized instrument in the second configuration of theinteractive computer program. The method then comprises displaying 8040at least images of the virtualized instrument at the position in thesecond configuration on the second display.

The configuring 8020 of the position for the virtualized instrument inthe second configuration may be performed from a management interface ofan engine of the interactive computer program. The interactive computerprogram engine (e.g., simulation engine) may also allow, in addition tothe position for the virtualized instrument in the differentconfigurations, management of different settings of the interactivecomputer program (e.g., simulation parameters) and/or of the modularinfrastructure 7000 (e.g., general lighting, ambient temperature). Theinteractive computer program engine may for instance manage the computergenerated environment loaded from an environment database (not shown)and may also influence the interactive computer program behavior (e.g.,by implementing certain interactive sessions or simulation scenarios,etc.). The interactive computer program engine, when present, maycomprise a network interface module (not shown) and/or dedicated wire orwireless interfaces (not shown) to interact with other modules of themodular infrastructure 7000 or with other external network modules(e.g., one or more additional infrastructures and/or a shared ordedicated instructor module), for instance, via a network.

Even though explicit mention(s) of possible synergy between the firstset of embodiments and the second set of embodiments of the presentinvention have not necessarily been made throughout the description,skilled persons will be able to appreciate that their features mayadvantageously be used completely or partially together to provide evenmore advantageous embodiments of the present invention.

Similarly, even though explicit mentions of memory module(s) and/orprocessor module(s) are not made throughout the description of thepresent examples, persons skilled in the art will readily recognize thatsuch modules are used in conjunction with other modules of theinfrastructures to perform routine as well as innovative steps relatedto the present invention. The processor module may represent a singleprocessor with one or more processor cores or an array of processors,each comprising one or more processor cores. The memory module maycomprise various types of memory (different standardized or kinds ofRandom Access Memory (RAM) modules, memory cards, Read-Only Memory (ROM)modules, programmable ROM, etc.). The network interface represents atleast one physical interface that can be used to communicate with othernetwork nodes. The network interface may be present in one or more ofthe modules of the infrastructure and may be made visible to the othermodules of the infrastructure through one or more logical interfaces.The actual stacks of protocols used by the physical network interface(s)and/or logical network interface(s) of the network interface do notaffect the teachings of the present invention. The variants of processormodule, memory module, network interface and database(s) usable in thecontext of the present invention will be readily apparent to personsskilled in the art.

A method is generally conceived to be a self-consistent sequence ofsteps leading to a desired result. These steps require physicalmanipulations of physical quantities. Usually, though not necessarily,these quantities take the form of electrical or magnetic/electromagneticsignals capable of being stored, transferred, combined, compared, andotherwise manipulated. It is convenient at times, principally forreasons of common usage, to refer to these signals as bits, values,parameters, items, elements, objects, symbols, characters, terms,numbers, or the like. It should be noted, however, that all of theseterms and similar terms are to be associated with the appropriatephysical quantities and are merely convenient labels applied to thesequantities. The description of the present invention has been presentedfor purposes of illustration but is not intended to be exhaustive orlimited to the disclosed embodiments. Many modifications and variationswill be apparent to those of ordinary skill in the art. The embodimentswere chosen to explain the principles of the invention and its practicalapplications and to enable others of ordinary skill in the art tounderstand the invention in order to implement various embodiments withvarious modifications as might be suited to other contemplated uses.

What is claimed is:
 1. An infrastructure for an interactive computerprogram comprising a computer generated environment, the infrastructurecomprising: an instrument module replicating a first portion and a thirdportion of a cockpit from a simulated vehicle, wherein the interactivecomputer program simulates the simulated vehicle of the computergenerated environment and wherein a second infrastructure replicates asecond portion and the third portion of the cockpit from the simulatedvehicle, the instrument module comprising: at least one tangibleinstrument for at least one user to interact within the computergenerated environment, the at least one tangible instrument beingaccessible to the at least one user of the interactive computer program,the at least one tangible instrument being relevant for the simulatedvehicle of the computer generated environment; at least one virtualizedinstrument not accessible to the at least one user of the interactivecomputer program, the at least one virtualized instrument being relevantfor the simulated vehicle of the computer generated environment; atleast one shared tangible instrument, replicating the third portion ofthe cockpit, accessible to the at least one user, wherein acorresponding shared tangible instrument, replicating the third portionof the cockpit, is accessible to a real co-user of the interactivecomputer program in the second infrastructure, wherein the third portionof the cockpit of the simulated vehicle is different from the firstportion of the cockpit and from the second portion of the cockpit in thesecond infrastructure; and an instrument actuator for moving the atleast one shared tangible instrument based on movements of thecorresponding shared tangible instrument from the real co-user in thesecond infrastructure; a first display positioned in front of the atleast one user for displaying images from the computer generatedenvironment of the interactive computer program; and a second displaypositioned on one side of the instrument module for: displaying at leastimages of the at least one virtualized instrument and of a virtualizedparticipant of the interactive computer program representing the realco-user, wherein the tangible instrument is not accessible to thevirtualized participant of the interactive computer program and the atleast one virtualized instrument is accessible to the virtualizedparticipant of the interactive computer program; and displayingcomplementary images of the cockpit of the simulated vehicle, thecomplementary images comprising images of the at least one virtualizedinstrument and of the virtualized participant of the interactivecomputer program in the cockpit of the simulated vehicle.
 2. Theinfrastructure of claim 1 further comprising a seat for the at least oneuser, the at least one tangible instrument being accessible while the atleast one user is one of being seated, in motion or standing.
 3. Theinfrastructure of claim 1, wherein the virtualized participant iscontrolled by artificial intelligence to mimic reactions of the realco-user of the interactive computer program.
 4. The infrastructure ofclaim 1 further comprising a sightline tracking module for tracking atleast one factor of the user's sightline for geometry correction of theimages displayed on at least one of the first display and the seconddisplay.
 5. The infrastructure of claim 1, wherein the first portion ofthe cockpit of the simulated vehicle in the infrastructure is differentfrom the second portion of the cockpit of the simulated vehicle in thesecond infrastructure.
 6. A method for providing an interactive computerprogram in a first infrastructure and a second infrastructure, themethod comprising: providing a tangible instrument, in the firstinfrastructure, replicating only a first portion of a cockpit from asimulated vehicle, for at least one user to interact with theinteractive computer program, wherein a first display screen of thefirst infrastructure displays a computer generated environment of theinteractive computer program and wherein the interactive computerprogram simulates the simulated vehicle of the computer generatedenvironment, the tangible instrument being relevant for the simulatedvehicle of the computer generated environment; providing a secondtangible instrument, in the second infrastructure, replicating only asecond portion of the cockpit from the simulated vehicle, for a realco-user to interact with the interactive computer program from thesecond infrastructure, wherein a first display screen of the secondinfrastructure displays the computer generated environment of theinteractive computer program to the real co-user; providing at least oneshared tangible instrument in the first infrastructure replicating athird portion of the cockpit, different from the first portion,accessible to the at least one user in the first infrastructure;providing a corresponding shared tangible instrument in the secondinfrastructure replicating the third portion of the cockpit, differentfrom the second portion, accessible to the real co-user in the secondinfrastructure; in the first infrastructure, displaying images of avirtualized instrument of the interactive computer program on a seconddisplay screen of the first infrastructure positioned on one side of thetangible instrument, the at least one virtualized instrument beingrelevant for the simulated vehicle of the computer generated environmentand the second tangible instrument corresponding to the virtualizedinstrument; in the first infrastructure, displaying images of avirtualized participant of the interactive computer program,representing the real co-user, on the second display screen, wherein thetangible instrument is not accessible to the virtualized participant andthe virtualized instrument is accessible to the real co-user; in thesecond infrastructure, displaying images of the tangible instrument fromthe first infrastructure as a second virtualized instrument of theinteractive computer program to the real co-user, wherein the tangibleinstrument from the first infrastructure is not accessible to the realco-user and the second tangible instrument corresponding to thevirtualized instrument is accessible to the real co-user; and using afirst actuator in the first infrastructure, moving the at least oneshared tangible instrument in the first infrastructure based onmovements of the corresponding shared tangible instrument from the realco-user in the second infrastructure.
 7. The method of claim 6, furthercomprising controlling the virtualized participant by artificialintelligence to mimic reactions of the real co-user of the interactivecomputer program.
 8. The method of claim 6, further comprising, using asecond actuator in the second infrastructure, moving the correspondingshared tangible instrument in the second infrastructure based onmovements of the at least one shared tangible instrument from the atleast one user in the infrastructure.
 9. The method of claim 6, whereinthe first portion of the cockpit of the simulated vehicle replicated inthe first infrastructure is different from the second portion of thecockpit of the simulated vehicle replicated in the secondinfrastructure.